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DESCRIPTION 

Surveying Instrument and Electronic Storage Medium 

Technical Field 

The present invention relates to a surveying 
instrument and an electronic storage medium, and more 
particularly to non-prism measurement that is capable of 
measuring a measuring point in corners . 

Background Art 

A technique for performing three-dimensional 
measurement by use of a non-prism type total station 

(surveying instrument) , which does not use a reflection 
member such as a corner cube, has been developed. 

However, the problem to be solved was that, for 
example, when the outward appearance of a building is 
measured, it was extremely difficult to measure the edges 

(corners) of the building. Because the measurement is 
performed by use of a measuring light beam such as a laser 
light beam which is emitted from a non-prism type total 
station (surveying instrument) , it is difficult to measure 
the edge . 

Disclosure of Invention 

The present invention has been devised taking the 
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above-mentioned problem into consideration. An object of 
the present invention is to provide a surveying instrument 
for measuring the distance to a target to be measured, a 
horizontal angle, and a vertical angle by use of reflected 
light. An imager can be connected to the surveying 
instrument. In addition, an arithmetic processing means 
can determine a three-dimensional position of a plane part 
by determining from at least three measuring points an 
equation that includes the plane part as the target to be 
measured, and then by associating digital image data to 
which the plane part belongs with the equation so that the 
plane part is identified. 

According to the present invention, it is also 
possible to determine a three-dimensional position of the 
plane part by extracting edges of at least two intersecting 
straight lines forming the plane part, and by determining 
the straight lines using the least-squares method or the 
conditional least-squares method on the basis of image data 
of the edges, and then by calculating an intersection point 
of the straight lines. 

According to the present invention, if at least two 
plane parts successively intersect with each other, edges 
of three straight lines forming the angle are extracted, 
and on the basis of image data of the edges, the straight 
lines are determined by the least-squares method or the 
conditional least-squares method, and then the angle which 
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is an intersection point of the straight lines is 
calculated to determine a three-dimensional position of the 
plane part . 

According to the present invention, if the plane 
part includes a straight line, a position and the length of 
the straight line can also be calculated by specifying the 
straight line. 

According to the present invention, if the plane 
part has a window bordered by straight lines, the window is 
specified to identify the window, which makes it possible 
to calculate a position and a shape of the window. 

According to the present invention, if there is a 
point located on the plane part which is the target to be 
measured, it is also possible to determine the three- 
dimensional position by determining a center-of -gravity 
position of image data of the point, and then by 
associating the center-of -gravity position with the three 
measuring points . 

According to the present invention, if the surveying 
instrument faces the target to be measured, it is also 
possible to calculate a three-dimensional position of the 
plane part by determining from a measured value of one 
point an equation which includes the plane part as the 
target to be measured, and then by associating digital 
image data to which the plane part belongs with the 
equation so that the plane part can be identified. 
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According to the present invention, a straight line 
or a window, which is included in a plane part, can also be 
specified by the collimation of a telescope included in the 
surveying instrument. 

According to the present invention, a straight line 
or a window, which is included in the plane part, can also 
be specified by pointing an image displayed on a display 
unit included in the surveying instrument . 

In addition, the edges can also be extracted by use 
of a spatial filter such as Laplacian. 

A three-dimensional measurement method according to 
the present invention is used in a surveying instrument for 
measuring the distance to a target to be measured, a 
horizontal angle, and a vertical angle by use of reflected 
light. The surveying instrument is so devised that an 
imager for obtaining a digital image in a measurement 
direction can be connected to the surveying instrument. 
The three-dimensional measurement method -comprises the 
following steps: a first step for determining at least 
three measuring points of a plane part, and then for 
measuring the measuring points; a second step for 
determining an equation, which includes the plane part, 
from data of the distance and the angles of the three 
measuring points that have been obtained by the 
measurements; and a third step for associating the digital 
image data to which the plane part belongs with the 
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equation. A three-dimensional position of the plane part 
can be determined from the image data that identifies the 
plane part and from the equation that includes the plane 
part . 

An electronic storage medium such as a FD, a CD, a 
DVD, a RAM, a ROM, or a memory card is used when three- 
dimensional measurement is performed by use of data 
obtained from a surveying instrument and an imager, which 
measure the distance to a target to be measured, a 
horizontal angle, and a vertical angle using reflected 
light. As a result of executing an arithmetic processing 
means, it is possible to determine a three-dimensional 
position of a plane part by determining from at least three 
measuring points an equation that includes the plane part 
as the target to be measured, and then by associating 
digital image data to which the plane part belongs with the 
equation so that the plane part can be identified. 

Brief Description of the Drawings 

Fig. 1 is a diagram illustrating the principles of 
thi s embodiment ; 

Fig. 2 is a diagram illustrating the principles of 
this embodiment ; 

Fig. 3 is a diagram illustrating the principles of 
this embodiment ; 

Fig. 4 is a diagram illustrating the principles of 



thi s embodiment ; 

Fig. 5 is a diagram illustrating the principles of 
this embodiment; 

Fig. 6 is a diagram illustrating the principles of 
this embodiment ; 

Fig. 7 is a diagram illustrating the principles of . 
this embodiment ; 

Fig. 8 is a diagram illustrating a surveying 
instrument 1000 according to the embodiment of the present 
invention; 

Fig. 9 is a diagram illustrating a surveying 
instrument 1000 according to the embodiment of the present 
invention; 

Fig. 10 is a diagram illustrating a telescope unit 

4; 

Fig. 11 is a diagram illustrating the operation of 
this embodiment; and 

Fig. 12 is a diagram illustrating the principles of 
this embodiment. 

Best Modes for Carrying out the Invention 
Principles 

Here, the principles will be described using an 
example in which as shown in Figs. 1 and 2, three- 
dimensional coordinates (X, Y, Z) of a corner part 2000a of 
a building 2000 which is a target to be measured are 
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measured. The principles are described by use of the 
building 2000 having planes formed of straight lines, and 
the like, which seem to be a main usage pattern of the 
present invention . 

To begin with, as shown in Fig. 1, a surveying 
instrument which is placed at a reference point O, 
coordinates of which are known, collimates a a surface 
forming the building 2000. Three points (preliminary 
measuring points) substantially forming a triangle on the a 
surface are chosen, and then the distance to each point, a 
horizontal angle, and a vertical angle are measured. 

On the basis of measured data, an equation of a 
plane which includes the preliminary measuring points is 
calculated. The plane which includes the preliminary 
measuring points includes the a surface. 

It is to be noted that the measurement of a plane of 
a building or the like using a non-prism type surveying 
instrument is described in Japanese Patent Application 
Laid-Open No. Hei 2000-97703 by the applicant of the 
application concerned . 

In addition to the measurement, digital image data 
of the building 2000 which is the object to be measured is 
obtained by the imager 100. 

In a configuration in which an image is coaxial with 
the collimation, the center of the collimation coincides 
with the center of the image. Accordingly, a position in 
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the image can be expressed as horizontal and vertical 
angles relative to the, center of the collimation. 

On the basis of the horizontal angle data and the 
vertical angle data relative to the center of the 
collimation center, the position in the image is calculated 
by the horizontal angle and the vertical angle. 

An image pickup element such as an image sensor, 
which is used to obtain digital image data, is constituted 
of pixels that are arrayed in a matrix. A position of each 
pixel arranged in the image is known. 

When a corner of a building formed of straight lines 
is determined, an equation of the straight lines is derived 
from the least-squares method or the conditional least- 
squares method on the basis of variations in light 
receiving of each pixel, and thereby it is possible to 
determine a position of an intersection point in the image 
as well as horizontal and vertical angles relative to the 
center of the image. The determined horizontal and 
vertical angles coincide with a horizontal angle and a 
vertical angle of the corner of the building on a a surface 
relative to the center of the collimation. Because the 
horizontal angle data and the vertical angle data of the 
center of the collimation are known, horizontal angle data 
and vertical angle data of the angle of the building can be 
immediately determined. If the distance from the center of 
the collimation is measured, it is possible to determine a 



three-dimensional position of the corner of the building by- 
use of the determined equation of the a surface. 

Incidentally, if the image is not coaxial with the 
collimation, proper corrections can also be made. 

A first image pickup element 110 picks up a wide- 
angle image; and a second image pickup element 12 0 picks up 
a narrow-angle image. The wide-angle image and the narrow- 
angle image are associated with each other. The wide-angle 
image is suitable for the whole image or a close-range 
view; and the narrow-angle image is suitable for, for 
example, a magnified image, or a distant view. 

Incidentally, if the magnification of the telescope 
can be zoomed in or out, one image pickup element can also 
be used as both the first image pickup element 110 and the 
second image pickup element 120. 

In addition, an image of the telescope in proximity 
to the preliminary measuring point A is as shown in Fig. 2. 
Accordingly, aligning the image with a cross line also 
makes it possible to determine a preliminary measuring 
point in proximity to the window. 

A position in the digital image is associated with 
measured data of the preliminary measuring point by 
surveying. The a surface to which the preliminary 
measuring point belongs is bordered by straight lines to 
thereby form a surface. When a position of the building is 
identified, more specifically, when a coordinate position 
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is identified to survey the building, since the building is 
shaped like a box in many cases, identifying corners makes 
it possible to easily obtain its coordinates. 

To begin with, edges of the straight lines forming 
the a surface of image data are extracted by image 
processing. With the object of the extraction of the edges, 
for example, a spatial filter such as the Laplacian is used 
to emphasize the edges. This Laplacian emphasizes the 
edges using a differential image. 

Next, two straight lines, a first straight line LI 
and a second straight line L2 , which are formed in the 
upper wall of the building 2 000, are determined on the 
basis of the image data. Then, based on the relationship 
between an intersection point of the two straight lines and 
a position of a preliminarily measuring point in the image, 
coordinates (X, Y, Z) of the corner part 2000a are 
determined . 

The position of the preliminary measuring point is 
identified by a horizontal angle (direction angle) and a 
vertical angle from a known point as viewed from a 
reference point. 

An equation of the two straight lines is determined 
by applying the least -squares method to image data 
variations . 

The straight lines can be determined by, for example, 
the least-squares method. 
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On the assumption that the equation of the straight 
line is y = ax + b, the above description is given by the 
two straight lines, that is to say, the first straight line 
LI and the second straight line L2 . However, three or more 
straight lines may also be set so as to determine their 
intersection points . 

In this case, there is exhibited an effect of 
increasing the accuracy of the intersection points. 

It is possible to determine two straight lines a, b 
by use of the least-squares method as described below. It 
is to be noted that if the conditional least-squares method 
and/or the weighted least-squares method are used as the 
least-squares method, the straight lines can be determined 
with higher accuracy, and thereby the coordinates can be 
determined with higher accuracy. In case of the 
conditional least-squares method, by making it a condition 
that, for example, the outward appearance of the building 
is formed of perpendicular straight lines, the corner of 
the building is considered to exist on the straight lines, 
and a connected line is determined as a straight line. 
Thus, it is found that the building perpendicularly stands. 
The conditioning makes it possible to minimize the 
influence of distortion of an image optical system, and 
also to make a calculation process easy. Moreover, it is 
also possible to determine the coordinates with higher 
accuracy by applying the weighted least -squares method in 
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which detection of receiving light on a pixel basis is 
taken into consideration. 

Mathematical expression 1: 

Solution of the least-squares method: in case of y = 

ax + b 



x x a + b = y x 
x 2 a + b = y 2 

x n a + b = y n 
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If the first straight line LI is defined as y = a x x + 
bi (Equation 1) and if the second straight line L.2 is 
defined as y = a 2 x + b 2 (Equation 2), an intersection point 
of these two straight lines can be virtually determined as 
the corner part 2000a of the building 2000, which 
corresponds to the edge. 

Moreover, if the distance from the surveying 
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instrument 1000 placed at the reference point to the 
preliminary measuring point 2000b, and data of a horizontal 
angle (direction angle) and of a vertical angular, are used, 
it is possible to calculate three-dimensional coordinates 

(X, Y, Z) of the measuring point. 

To be more specific, three-dimensional coordinates 

(X b , Y b , Z b ) of the preliminary measuring point 2 000b can be 
measured on the basis of coordinates of the reference 
position of the surveying instrument 1000, and also on the 
basis of the angle of orientation of this reference 
position. Therefore, the three-dimensional coordinates (X, 
Y, Z) of the corner part 2000a of the building 2000 which 
is on the same plane can be calculated. 

Incidentally, the high accuracy cannot be achieved 
through only the image processing. For example, although 
the edges of the image of the building are straight lines, 
data forming an image linearly varies because there is also 
a pixel that is partially received. For this reason, if a 
position of the corner of the building is determined on the 
basis of image data, it is not possible to achieve the 
accuracy that is higher than the fineness of the arranged 
pixels . 

What was described above is the case where the 
building 2000, or the like, which is the target to be 
measured, is obliquely collimated. This is a state of 
substantially facing each other. When collimating a 
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position substantially perpendicular to the plane part, to 
be exact, surveying by three points is required. However, 
even surveying by one point will not produce a practical 
problem. In case of the one -point surveying, even one 
point suffices instead of three-point surveying. 

Furthermore, in the above description, the plane 
part is determined on the basis of the detection of the 
edges of the straight lines. However, the following method 
can also be used: detecting an intersection point in a 
plane part, or a mere center-of -gravity position of a point, 
from image data; and thereby determining its intersection 
point or a three-dimensional position of the point. 

Detailed Description of the Preferred Embodiments 

Embodiments of the present invention will be 
described with reference to drawings as below. 

As shown in Figs. 8 and 9, a surveying instrument 
1000 is a total station, which comprises an electronic 
theodolite for detecting angles (a vertical angle and a 
horizontal angle), and a light-wave range finder. 

The surveying instrument 1000 comprises the 
following: a telescope unit 4; a frame 3 for supporting the 
telescope unit 4 so that the telescope unit 4 can swing up 
and down; and a base 2 for supporting the frame 3 so that 
the frame 3 can turn horizontally. The base 2 can be 
connected to a tripod, or the like, through a leveling 
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plate 5 . 

The surveying instrument 1000 is provided with an 
operation panel 7 which is a part of operation/input unit 
5000. A display 6 which is a part of a display unit 4300 
is attached to the surveying instrument 1000. Moreover, an 
objective lens 8 is projected from the telescope unit 4. 

An imager 100 is used to convert data of an image 
device into digital data. For example, the imager 100 is 
an electron camera such as a digital camera. This imager 
100 comprises a first imager 110 for picking up a wide- 
angle image, and a second imager 120 for picking up a 
narrow-angle image . 

Here, an optical configuration of the telescope unit 
4 will be described with reference to Fig. 10. 

The telescope unit 4 comprises the objective lens 8, 
a dichroic mirror 20, a condensing lens 41, a third half 
mirror 33, a first image sensor 210, a second image sensor 
220, and a focus lens 12. 

The dichroic mirror 20 includes a first prism 21, a 
second prism 22, and a third prism 23. The dichroic mirror 
20 includes a first half mirror 24 and a second half mirror 
25. 

It is so devised that a light beam incident from the 
objective lens 8 enters into the dichroic mirror 20, a 
measuring light beam and a part of visible light are 
reflected by the first half mirror 24, and then through the 
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condensing lens 41, an image is formed in both a first 
image sensor 210 and a, second image sensor 220. 

Only the measuring light beam is reflected in the 
second half mirror 25, and thereby the distance is measured. 

After the light beam has passed through the 
condensing lens 41, a part of the light beam is reflected 
by the third half mirror 33, and its image is formed in the 
second image sensor 220. In addition, the light beam which 
has passed through the third half mirror 33 results in 
image formation in the first image sensor 210. 

A control processor 4000 instructs a display unit 
4300 to display a light receiving signal that has been 
received by the first image sensor 210 and by the second 
image sensor 220. Incidentally, the first image sensor 210 
is associated with the first imager 110, and the second 
image sensor 220 is associated with the second imager 120. 

The light beam which has passed through the first 
half mirror 24 is introduced into an eyepiece through the 
focus lens 12 . 

Next, an electric configuration of the surveying 
instrument 1000 according to this embodiment will be 
described with reference to Fig. 8. 

The surveying instrument 1000 comprises a distance 
measuring unit 1100, an angle measuring unit 1400, a 
storage unit 4200, the display unit 4300, a drive unit 4400, 
the control processor 4000, and the operation/input unit 
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5000. Here, the storage unit 4200 is used to store data, a 
program, and the like. The display unit 4300 and the 
operation/input unit 5000 enable a user to operate the 
surveying instrument 1000. 

The distance measuring unit 1100 uses a non-prism 
type light-wave range finder. The distance measuring unit . 
1100 comprises a light emitting unit 1110 and a light 
receiving unit 1120. The light emitting unit 1110 emits a 
distance measuring light beam in a direction of a target to 
be measured. A light beam reflected from the target to be 
measured enters into the light receiving unit 112 0, and 
thereby the distance to the target to be measured can be 
measured. 

To be more specific, the distance from the surveying 
instrument 1000 to the target to be measured is calculated 
by the time difference from the time when the light 
emitting unit 1110 emits pulses of light until the light 
receiving unit 1120 receives the pulses of light. It is to 
be noted that this arithmetic operation is executed by the 
control processor 4000. 

An angle measuring unit 1400 comprises a vertical- 
angle angle measuring unit 1410 and a horizontal-angle 
angle measuring unit 1420. In this embodiment, a 
horizontal angle encoder and a vertical angle encoder are 
used. Each of the horizontal and vertical angle encoders 
includes a rotor mounted on the turning unit, and a stator 
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in which a fixed unit is formed. Incidentally, the angle 
measuring unit 1400 corresponds to an angle detector. 

The drive unit 4400 comprises a horizontal drive 
unit 4410 and a vertical drive unit 4420. By use of a 
motor, the drive unit 44 0 0 can turn the surveying 
instrument 1000 both in the horizontal direction and in the 
vertical direction . 

The control processor 4000 includes a CPU, and 
executes various kinds of arithmetic operation. 

Next, one example will be described. In the example, 
as shown in Figs. 3 and 6, three-dimensional coordinates (X, 
Y, Z) of the corner part 2000a of the building 2000 which 
is a target to be measured are measured. 

To begin with, as shown in Fig. 11, in a step 1 
(hereinafter "step" is abbreviated to S) , three points are 
properly determined as preliminary measuring points A, B, C 
on a wall surface in proximity to the corner part 2000a in 
Fig. 3. Next, the distance measuring unit 1100 of the 
surveying instrument 10 00 measures the distance to the 
preliminary measuring points A, B, C and a horizontal angle 
and a vertical angle. In addition, the imager 100 picks up 
an image of the building 2 000 which is the target to be 
measured. The imager 100 allows the first imager 110 to 
pick up a wide-angle image, and the second imager 120 to 
pick up a narrow-angle image. Accordingly, either of them 
is selected if necessary. 
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Next, in a step S2 , from the image obtained by the 
imager 100, an operation unit 13 00 of the surveying 
instrument 1000 specifies straight lines in proximity to 
the preliminary measuring points A, B, C that have been 
measured by the surveying instrument 1000. To be more 
specific, straight lines forming the corner of the building 
2000 are extracted. 

The operation unit 1300 of the surveying instrument 
1000 can emphasize edges by use of a spatial filter such as 
Laplacian . 

Moreover, in a step S3, the operation unit 1300 of 
the surveying instrument 1000 determines two straight lines, 
a first straight line LI and a second straight line L2 , 
forming the corner of the building 2000. The straight 
lines can be determined by, for example, the least -squares 
method or the conditional least -squares method. 

Next, in a step S4 , the operation unit 1300 of the 
surveying instrument 1000 can determine coordinates (X, Y, 
Z) of the angle part 2000a from the preliminary measuring 
points and an intersection point of the two straight lines. 

To be more specific, because the surveying 
instrument 1000 can measure three-dimensional coordinates 
of the preliminary measuring points A, B, C, the operation 
unit 1300 of the surveying instrument 1000 can calculate 
three-dimensional coordinates (X, Y, Z) of the corner part 
2000a of the building 2000 which is on the same plane 
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identified by the preliminary measuring points A, B, C. 

Moreover, an image of the telescope is formed as 
shown in Fig. 4. Accordingly, positioning a cross line to 
a place near from the straight line makes it possible to 
determine the preliminary measuring point A (al, pi) in 
proximity to the first straight line LI, and the 
preliminary measuring point B (a2, p2) in proximity to the 
second straight line L2 . Further, as shown in Fig. 5, 
positioning a cross line to the preliminary measuring point 
C (a3, p3 ) in proximity to the corner also enables the 
determination . 

How to calculate the height (depth) Z will be 
described with reference to Fig. 12. 

An equation of a plane formed by a triangle AP1P2P3 
is expressed as below. 

a'X+b'Y+c' = Z (Equation 3) 
where, if P x (x lr y lt zj , P 2 (x 2/ y 2 , z 2 ) , P 3 (x 3 , y 3 , Z3) are 
known, following Equation 4 holds true: 



V*3 >2 1 



b 1 



Z>2 



(Equation 4) 



Solving this equation 4 as simultaneous equations makes it 
possible to determine a 1 , b', c 1 . 

If a 1 , b', c 1 are determined, the height of all 
vertexes of the triangle (Pi, P 2/ P3) can be calculated by: 
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Zj = a'Xj + b'yj + c' 
This is called TIN (triangular net) . 

Fig. 7 illustrates a building having no corner part. 
In this case, two planes orthogonal to the building 2000 
are first determined. Then, on the assumption that their 
straight lines are extended to form a corner part, its 
three-dimensional position is calculated, and thereby 
coordinates of the position are determined. Moreover, each 
window shown in Fig. 3 is a part bordered by straight lines. 
Therefore, if a window is specified, applying an equation 
of the straight lines makes it possible to identify a 
position of the window relative to a a surface, and a shape 
of the window. 

In addition, if a plane part includes a straight 
line, specifying the straight line also makes it possible 
to calculate a position and the length of the straight line. 

Moreover, if the plane part has a window bordered by 
straight lines, specifying the window to identify the 
window also make it possible to calculate a position of the 
window . 

Further, it is also possible to specify a straight 
line or a window, which is included in a plane part, by the 
collimation of the telescope provided on the surveying 
instrument . 

Furthermore, it is also possible to specify a 
straight line or a window, which is included in the plane 
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part, by pointing an image displayed on the display unit 
included in the surveying instrument . 

It is to be noted that a program which describes 
operational steps to be performed by the operation unit 
13 00 of the surveying instrument 1000 can be stored in an 
electronic storage medium such as a FD, a CD, a DVD, a RAM, 
a ROM, and a memory card. 

In order to increase the accuracy, it is necessary 
to precisely calibrate both the surveying instrument 1000 
and the imager 100. 

The present invention which is configured as above 
is a surveying instrument for measuring the distance to a 
target to be measured, a horizontal angle, and a vertical 
angle by use of reflected light. It is so devised that an 
imager for obtaining a digital image which is associated 
with both a horizontal angle and a vertical angle can be 
connected to this surveying instrument . The surveying 
instrument comprises an arithmetic processing means for 
determining a three-dimensional position of a plane part by 
determining from at least three measuring points an 
equation that includes the plane part as a target to be 
measured, and then by associating digital image data to 
which the plane part belongs with the equation so that the 
plane part is identified. Accordingly, even if non-prism 
measurement is used, a measuring point in a corner part can 
be measured, which is a produced effect. 
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Industrial Applicability 

The present invention relates to a surveying 
instrument, and more particularly to non-prism measurement 
that is capable of measuring a measuring point in a corner 
part. An imager can be connected to this surveying 
instrument. In addition, an arithmetic processing means 
can determine a three-dimensional position of a plane part 
by determining from at least three measuring points an 
equation that includes the plane part as a target to be 
measured, and then by associating digital image data to 
which the plane part belongs with the equation so that the 
plane part is identified. 



